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Abstract. We prove that the error term A(R) in the Weyl asymptotic formula 

VolM , k , s 
#{E n < R 2 } = — R 2 + A{R), 

47T 

for the Laplace operator on a surface of revolution M satisfying a twist hypothesis, has the form 
A{R) = R l / 2 F(R) where F(R) is an almost periodic function of the Besicovitch class B 2 , and the 
Fourier series of F(R) in B 2 is £ 7 ^(7) cos(|7|i? - <j>) where the sum goes over all closed geodesies 
on M, and ^(7) is computed through simple geometric characteristics of 7. We extend this result 
to surfaces of revolution, which violate the twist hypothesis and satisfy a more general Diophantine 
hypothesis. In this case we prove that A(R) = R 2 / 3 ^(R) + R 1 / 2 F{R), where &(R) is a finite sum 
of periodic functions and F(R) is an almost periodic function of the Besicovitch class B 2 . The 
Fourier series of &(R) and F(R) are computed. 
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1. Introduction 



Let M be a two-dimensional smooth compact manifold which is homeomorphic to a sphere, 
and which is a surface of revolution in R 3 , with an axis A and poles N and S (see Fig.l). The 
geodesic flow on M is a classical integrable system due to the Clairaut integral, 

r sin a = const . (1.1) 

In the present work we are interested in high energy levels of the corresponding quantum system, 

-Au n = E n u n . (1.2) 

Let s be the normal coordinate (the length of geodesic) along meridian and 

r = f(s), 0< S <L, (1.3) 

be the equation of M, where r is the radial coordinate. Then 

A -'«-s ('<•>!) + '<•>-'&■ (L4> 

where ip is the angular coordinate. 

We will assume that f(s) has a simple structure, so that 

f'(s)^0, s^s max ; /"(w)^0, (1.5) 

where 

/(w) = max f(s) = / max . 

0<s<L 

For normalization we put /max = 1- Another assumption on M is the following twist hypothesis. 
Consider the equator on M, 

Je = {s = s max , < (p < 2ir}, 

(we do not assume that M is symmetric with respect to 7^, but we still call 7^ the equator keeping a 
visual interpretation of objects on M), and a geodesic 7 which starts at xq = (s = s max , 99 = 0) G 7^ 
at some angle — 7r/2 < a < vr/2 to the direction to the north. The Clairaut integral on 7 is 
/ = sina ) and we can parametrize 7 by— 1 < 7 < 1: 7 = 7(1). It follows from the Clairaut 
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integral that oscillates between two parallels, s = s+ and s = s_, where f(s-) = = /, 

so 7(1) intersects infinitely many times. Let x n be the n-th intersection of 7 with 7^, n € Z. 
Define 

r (7) = |7[x ,x 2 ]|, 

the length of 7 between x and x 2 , and 

u;(I) = (27r)- 1 (<p(x 2 )-cp(x )), 

the phase of 7 between xq and x 2 (see Fig. 1). Observe that oj(I) is defined mod 1. To define 
uj(I) uniquely, we choose a continuous branch of starting at uj(0) = 0. Then uj(— I) = —oj{I) 
and for I > 0, 

= ir- 1 f S+ ^ ds - 1. (1.6) 

Define r(l) = lim/^i_ r(l) and uj(1) = lim/^i_ 

It is easy to see that a finite geodesic 7 with the Clairaut integral < / < 1 is closed iff uj{I) 
is rational. More precisely, let 72(7) denote the number of revolutions of a closed geodesic 7 around 
the axis A and 711,(7) denote the number of oscillations of 7 along meridian. Then 

= (n( 7 )/m( 7 )) - I- 

To facilitate formulation of subsequent results we take the convention that a finite geodesic 7 with 
1=1, which goes along the equator, is closed iff both 11(7) and 

m( 7 ) = — — 

KU w(l) + l 

are integers. 

Twist Hypothesis (TH). u'(I) + 0, V/ G [0, 1]. 

To illustrate TH consider an ellipsoid of revolution, 

x 2 y 2 z 2 
\- - — I = 1. 

a 2 a 2 b 2 

If a < b (oblong ellipsoid), then co'(I) > 0, if a > b (oblate ellipsoid), then uj'(I) < 0; so TH holds 
in both cases. Curves (a) and (b) on Fig.2 are the graphs of uj{I) found with the help of computer 
for the ellipsoids of revolution with a = 1, b = 2 and a = 2, b = 1, respectively. The cross-sections 
of the ellipsoids are shown in the lower part of Fig.2. TH is violated for a sphere (a = b), when 



uj'(I) = 0. TH can be also violated for a bell-like shape of M shown on Fig.2 (see the cross-section 
(c) and the graph (c) of oj(I) on this figure) and in some other cases. 

Let 

N(R) = #{E n < R 2 } (1.7) 
be the counting function of E n . Then the Weyl law says that 

N(R) = ^R 2 + A(R) 

where A(R) = o(R 2 ), R — > oo. A general estimate of Hormander [Horl] gives 

A(R) = 0(R). 

This estimate is sharp for S 2 and some other degenerate surfaces for which closed geodesies cover 
a set of positive Liouville measure in the phase space. If the Liouville measure of the union of all 
closed geodesies in the phase space is 0, then as was shown by Duistermaat and Guillemin [DG], 

A(R) = o(R). 

For surfaces of negative curvature Selberg and Berard [Ber] proved a better estimate: 

A(R) = 0(R/ log R), 

and it is a very difficult open problem to show that A(R) = 0(R 1 ~ £ ) for some e > 0, even in 
the case of constant negative curvature (see recent works [Sar], [LS] and [HR] where statistics of 
eigenvalues and eigenfunctions of the Laplace operator on surfaces of constant negative curvature 
is discussed). 

For a flat torus A(R) reduces to the error term of the classical circle problem, and the best 
estimate here is due to Huxley [Hux]: 

A(i?) = 0(i? 46 / 73 (lo gj R) 315 / 146 ). 

A well-known conjecture of Hardy [Harl] 

A(R) = 0(i? (1/2)+£ ), Ve > 0, 

is probably also a very difficult open problem. On the other hand Hardy proved [Har2] that 

limsupir 1/2 |A(i?)| = oo, 

R— >oo 



so (1/2) + e is the best possible exponent. 

Colin de Verdiere [CdVl,CdV2] proved that for a generic surface of revolution of simple struc- 
ture 

A(R) = 0(R 2/3 ). (1.8) 

We prove in the present paper the following result: 

Theorem 1.1. Assume that M is a surface of revolution of simple structure, and M satisfies 
TH. Then 

N{R) = + R 1 / 2 F(R), (1.9) 

where F(R) is an almost periodic function of the Besicovitch class B 2 , and the Fourier series of 
F(R) in B 2 is 

F(R)= £ ^(7)cos(| 7 |i2-$, (1.10) 

closed geodesies 7 

where summation goes over all closed (in general, multiple) oriented geodesies 7 ^ on M, 4> = 
(tt/2) + (7r/4)sgnu/(7), and 

aw = vr-^-ir^vcor 1 / 2 ™^)- 3 / 2 

(l.n) 

= 7r - 1 (-l) m W|o; / (7)|- 1 / 2 T(7) 3 / 2 | 7 |- 3 / 2 , / = J( 7 ). 



In Theorem 1.2 we extend Theorem 1.1 to the case when TH is violated. In this case we 
introduce 

Diophantine Hypothesis (DH). Assume that to (I) has at most finitely many critical points 
< Ji < ■ • • < I k < 1 (so that I = 0,1 are not critical) with uj'(Ik) = 0, and uj"(Ik) 7^ 0, 
k = 1,...,K. Assume, in addition, that for every k = 1,...,K, co(Ik) is either rational or 
Diophantine in the sense that 3 1 > £ > and C > such that 



u{h) 

Q 



V^Q. (1.12) 



Theorem 1.2. Assume that M is a surface of revolution of simple structure and DH holds. 
Then 

N(R) = ^^R 2 + R 2 / 3 y <s> k ( R ) +R i/* F (R), (1.13) 

k: u>(I k )eQ 
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where $k(R) ar & bounded periodic functions, and F(R) is an almost periodic function of the Besi- 
covitch class B 2 . The Fourier series of$k(R) is 

* k (R) = (l/2)3- 2 / 3 r(2/3)vr- 4 / 3 r(/ fe ) 4 / 3 £ (-l)-W | 7 |" 4 / 3 sin(|^|^), (1.14) 

7: i( 1 )=i k 

and the Fourier series of F(R) is 

F(R)= A( 7 )cos(| 7 |i2-^(7)), (1-15) 

where ^(7) = (tt/2) + (7r/4) sgn a;' (/), I = and A(j) is given in (1.11). 

In the works [H-B], [BCDL], [Blel], [Ble2] and [BL] some general results were proved on the 
existence and properties of a limit distribution of any almost periodic function of the Besicovitch 
class B 2 (see especially Theorems 4.1-4.3 in [Blel] and Theorems 3.1, 3.3 in [Ble2]). Theorem 1.2 
combined with these results lead us to the following 

Corollary. Assume that M is a surface of revolution of simple structure and M satisfies TH 
or, more generally, DH. Then the normalized error function F '(R) in the formulas (1.9) and (1.13) 
has a limit distribution u(dt), i.e., for every bounded continuous function g(t) on the line, 



lim 1 / g(F(R))dR= f°° g(t)u(dt). 



T- 

If in addition, the lengths of all primitive closed geodesies on M with I > are linearly independent 

over Z, then v{dt) is absolutely continuous and the density function p(t) = u(dt)/dt is an entire 

function of t which satisfies on the real axis the estimates 
<p(t) < Cexp(-At 4 ), C,A>0, 

P(-t), 1 - P(t) > C exp(-A't 4 ), t > 0; C , A' > 0; P(t) = f p{t') dt' . 

Observe that Theorem 1 . 1 is a particular case of Theorem 1 . 2 , so we need to prove only Theorem 
1.2. The plan of the remainder of the paper is as follows. In Section 2 we present a theorem of Colin 
de Verdiere and show how with the help of this theorem to reduce Theorem 1.2 to a lattice-point 
problem for the Bohr-Sommerfeld quasi-classical approximation. Section 3 is auxiliary: here we 
investigate the asymptotics at infinity of the Fourier transform of the characteristic function of a 
plane domain with non-degenerate inflection points and angular points. In Section 4 we prove the 
lattice-point version of Theorem 1.2 for the number of lattice points inside a dilated plane oval 
with finitely many points of inflection. Section 5 is technical, and here we prove some lemmas used 
in Section 4. In Section 6 we prove Theorem 1.2. Finally in an Appendix we prove a 2/3-estimate 
for ovals with semicubic singularity. This estimate is used in the main part of the paper. 
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2. Quasi Classical Approximation 



Colin de Verdiere proved in [CdV2] the following result: 

Theorem CdV. If M is a surface of revolution of simple structure then 

Spectrum (-A) = {E ki = Z(k + (1/2), I); k,leZ, \l\ < k} 

with Z(p) = Z( Pl ,p 2 ) e C°°(R 2 ) such that 

Zip) = Z 2 (p) + Z (p) + Odpr 1 ), \p\ -> oo, 



where 



Z 2 (p),Z (p)eC°°(R 2 \{0}); Z 2 (p)>0, p^O, 



and 



Z j (\p) = \ j Z j {p), VA>0,p€R 2 , 



J = 0,2. 



In addition, in the sector {p\ > \p 2 \}, Z 2 (p) satisfies the equation 




where a,b are the turning points, i.e. 



Z 2 {p)-p 2 2 f- 2 {s) = for s = a,b. 



It is to be noted that the Bohr-Sommerfeld quantization rule is 




^E kl -Pf-2(s)d S = k + (1/2) -\l\, k>\l\ 



which is equivalent to the approximation 



E kl = Z 2 (k + (1/2), I). 



(2.1) implies that 



N(R) = #{E kl < R 2 } = #{(k, I) : Z(k + (1/2), I) < R 2 , \l\ < k}. 



Define 

Nbs(R) = #{(k, I) ■ Z 2 (k + (1/2), I) < R 2 , \l\ < k} (2.9) 
(BS stands for Bohr-Sommerfeld). 
Theorem 2.1. 

lim 1 / |Af(i?)-iVBs(i?)| 2 i?- 1 d J R = 0. (2.10) 

Proof. Define 

M = {n = (jfe + (1/2), I) : jfe, I e Z; |Z| < fc}. (2.11) 

Then 

N(R) - N BS (R) = (X(n; " XBs(n; #)), (2.12) 

ngM 

where %(p;i?) and XBs(p;i?) are the characteristic functions of the domains {Z(p) < R 2 } and 
{Z 2 {p) < R 2 }, respectively. Hence 

i I \N(R)-N BS (R)\ 2 R- 1 dR= J ( n ' n ') ( 2 - 13 ) 

n,n'eM 

with 



J(n, n ') = fJ Q (X(n; -R) - XBs(n; fl))(x(n'; i?) - X Bs(n'; R^R^dR. (2.14) 
Now, 3 C > such that 



X (n;i?) -XBs{n;R) =0 if dist {n, T R } > C[n| _1 , (2.15) 

where 

F R = { P GR 2 : Z 2 (p) = R 2 } = RT, F = {p G R 2 : Z 2 (p) = 1}. (2.16) 

Indeed, 

sup |Z(p)-Z 2 (p)| = C <oo, (2.17) 

PGR 2 

so if Z(p) = R 2 then for |e| < 1/2, 

\Z 2 (p{l + e)) - R 2 \ > \Z 2 {p(l + e)) - Z 2 (p)| - |Z 2 (p) - Z(p)| > Ci|p| 2 e - C . 
Hence if e = CH" 2 with C = 2C C^\ then 

±(Z 2 (p(l ± e)) - i? 2 ) > CCi - Co = C > 0, 



and 3 |e | < £ such that Z 2 (p(l + £o)) = R 2 , \p£o\ < C|p| x , which implies (2.15). 

Define X{p) = (Z 2 (p)) 1/2 . Then X(p) > and 

X(Xp) = XX (p) V A > 0,p G R 2 . 

(2.15) implies that 

l(n,n') = if |X(n) -X(n')| > Colnl" 1 . (2.18) 
In addition, (2.14), (2.15) imply that 

l(n,n')=0 if X(n)>2T, (2.19) 

and V n, n' , 

\I(n,n')\ < CT-Vl -2 - (2.20) 

From (2.18)-(2.20) 

J] /(n,n')<C ^ T-^nl" 2 £ 1. 

n,n'eM neM: X(n)<2T n'eM: |X(n)-X(n') | <Co \n\ - 1 

Due to the 2/3-estimate of Sierpinski-Landau-Randol-Colin de Verdiere [Sie], [Lan], [Ran], [CdVl], 

X l<C\n\ 2 /\ 

n'eM: \X(n)-X{n')\<C a \n\- 1 

hence 

^ I{n,n')<CT- 1 Yl l n l" 4/3 <CoT- 1/3 . (2.21) 

n,n'eM ngM : X(n)<2T 

Since (2.13) and (2.21) imply (2.10), Theorem 2.1 is proved. 

By (2.9) Nbs(R) is the number of lattice points (k + (1/2), Z) of a shifted square lattice in the 
sectorial domain 

n(R) = {p £ R 2 : Z 2 {p) < R 2 , \ P2 \ <Pi}- 

Observe that Q(R) is Q = 0(1) dilated with the coefficient R, so the problem of finding the 
asymptotics of N BS (R) as R — > oo reduces to a lattice-point problem about the asymptotics of 
the number of lattice points inside RQ, where is a sectorial domain between diagonals p 2 = ±pi 
which is bounded by the curve T = {Z 2 (p) = 1}. By (2.4) T is the graph of the function 

Pi = N + vr- 1 f ^/l-p 2 f-*(s)ds. 

J a 

Fig. 3 shows the curve T found with the help of computer for the surfaces of revolution presented 
on Fig.2 above. 

Sections 3-5 below are devoted to the lattice-point problem for arbitrary sectorial domain 
between diagonals which is bounded by a "generic" curve T. 
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3. Asymptotics of Fourier Transform of Nonconvex Domains 



In this section we consider the following auxiliary problem. Let $7 be a sectorial domain on a 

plane, which is bounded by two segments [0, zq], [0,z\] and by a smooth curve T which goes from 

zq to z\ (see Fig. 4). We will assume that T has at most finitely many points of inflection where the 

curvature cr(p) vanishes, and all the points of inflection are non-degenerate, i.e., — ^ at these 

ds 

points. We are interested in the asymptotics of the Fourier transform 

X(0 = / exp(ip£) dp, 
Jn 

as |£| — > oo. With the help of a partition of unity this problem can be reduced to a series of local 
problems of the following type. 

Let r be a smooth curve near some point p° G T and x(p) = 1 from one side of T and x(p) = 
from the other side of T (locally). Let ip(p) G Cg° be a C°°-function with compact support near 
p°. Assume in addition that ip(p) = 1 in the vicinity of p°. Then the local problem is: what is the 
asymptotics of 

X.iO = i f{p)x{p) exp(ip^) dp, 
J-R? 

as |£| -> oo? 

We will be also interested in the case when V has an angular point at p , and we will consider 
in a sequence the following cases: (a) V is either convex or concave near p°; (b) T has an inflection 
point at p°; (c) T has an angular point at p° with one side which is either convex or concave and 
with the other side which is a straight ray; (d) T is an angle between two straight rays; and (e) T 
is a straight line (see Fig. 5). 

In the case (a) the answer is the following well-known lemma. Let Tq C T be an open arc on 
T such that 

p° £T c{peT: <p(p) = l}, 

and 

V = {£ G R 2 \ {0} : 3p = p(0 G T such that n r (p) = l^"^}, 

where nr(p) is the vector of normal to T at p G T which looks in the direction where xip) = 0- 
Define 

nO=e-p(0. ^R 2 \{0}. (3.1) 
10 



For the sake of brevity we will denote cr(p(£)) by cr(£). We will assign a sign to the curvature <r(p), 
so that a(p) > if the region {x{p) = 1} is convex near p G T, and a(p) < if this region is 
concave near p. If p2 = f(pi) is the equation of T near some p G V in the coordinate system with 
an orthonormal basis ei, e 2 such that e 2 = n^ip), then 

*(p) = -/"(Pi)- (3-2) 

Lemma 3.1 (see [Hla]). If a(jp) ^ on T i/ien 

X(6 = (2vr)- 1 /2| C |-3/2| cj(0 |-i/2 cosW y (0 _ 0)) + 0(|^|- 5 / 2 ), if £ G V, (3.3) 

where 

= (7r/2) + (7r/4)sgn<7(O. (3.4) 



Assume now that p° is a non-degenerate point of inflection, i.e., a (p°) = and — (p°) / 0. 

as 

In this case p° is the turning point for nr(p), so that for small deviations of the direction of £ from 
nr(p°) we have either two points p = p±(£) with nr(p) = |£| _1 £ or no such point at all. Define for 

lif3per with n r (p) = ICI" 1 ^ 
0(£) = (3.5) 
otherwise. 

To be definite in the choice of p±(£) we will assume that er(p + (£)) > and <r(p_(£)) < 0. Let 
<J±(£) = f(p±(£)) an( i ^±(£) = £ ' P±(0- Let a(£) be the angular coordinate of £. Let finally 



/oo 
exp(itr + ir 3 /3)dr 
-oo 



be the Airy function. Recall that Ai (t) G C^R 1 ) and when t — > oo, 

Ai (-t) = tt" 1 / 2 *" 1 / 4 cos(C - (?r/4)) + 0(r 7/4 ), 

Ai'(-t) = 7T" 1 / 2 * 1 / 4 sin(C - (?r/4)) + 0(r 5/4 ), C = (2/3)t 3/2 

|Ai(i)|, |Ai'(t)| <Cexp(-t), 

which implies that for t ^ 0, 

|Ai (t) - e(-t)7r- 1/2 |t|- 1/4 cos(C - (tt/ 4 ))I < C|t|- 7/4 , 
|Ai'(t) - 0(-i)7r- 1/2 |t| 1/4 sin(C - (vr/4))| < C\t\~ 5 /\ 
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(3.6) 



where 6{t) = 1 for t > and 9(t) = for t < 0. 



Lemma 3.2. Assume that o~(p°) = and — (p°) ^ 0. Then there exist real valued functions 
a(a), b(a) near a = a(n r (p )) such that a(a ) = 0, a'(a ) ^ 0, b(a ) = Y(n r (p )) and 

X(0 = -iexp(^|6(a(0)){|er 4/3 Ai(|e| 2/3 a(«(0))n(a(0) 



+ i^r 5/3 Ai'(iei 2/3 a(«(0))^(«(e))} + o(ier 

where u(a), v(a) are C°° functions and 



■7/3' 



(3.7) 



u(a ) 



1/3 



(3.8) 



Corollary. If a(£) ^ a then 

\x(0 - 0(O(X + (O + X"(6)l < ^r 5/2 K£) - a r 7/4 (3.9) 

w/iere 

X ± (0 = ler 3/2 |2vr CT± (0r 1/2 exp(,(y ± (0 - 0±)), (3.10) 

0± = (vr/2)±(7r/4). 

Proof of Corollary. From (3.6) and (3.7) we obtain that for a(£) = a/ ao, 
Xm(0 = -iexp(i|^|6(a))|e|- 3/2 0(O["o(a)cos(|e|ao(a) - (tt/4)) + w (a) sin(|£|a (a) - (vr/4)) 

+ o(iei- 5/2 ia-a r 7/4 ) 

(3.11) 

with some ao(a),uo(a) and wo(«)- On the other hand, Lemma 3.1 gives us that for a fixed a(£) = 
a / a , 

Xm(0 = 0(0(xU0+X^))+Om- 5 / 2 ), |£|-oo (3.12) 

Comparing (3.11) with (3.12) we obtain that the main terms in these two asymptotics coincide, 
hence 

x m (o = *(ood(o + x- m (t)) + o(ier 5/2 i« - « r 7/4 ), 

which proves Corollary. 

Proof of Lemma 3.2. Consider an orthonormal basis ei, e2 on the plane with e2 = nr(p )- Let 
p = p° + Piei + p 2 C2 , £ = £i e i + ^2^2 and p 2 = f{Pi) be the equation of T near p°. Observe that 
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/(O) = /'(O) = /"(O) = and we can choose the direction of e\ in such a way that f"'(0) = ~j~(P°)- 
Integrating by parts in p 2 we obtain that 

X(0 = / V(p)x(p) e*p(ipQdp = -i^ 1 exp(ip°£) / <p(pi, /(pi)) exp(spi£i + if(pi)&)dpi 

JR 2 J-oo 

/oo 
/(pi)) exp[*|£|<I>(pi, a(0)]dpi + 0(1^), 
-oo 

where $(pi, a) = pi sin(a — ao) + /(Pi) cos(a — ao) is a C°° real valued function with 

$ _ d$ _ d 2 $ _ Q <9 3 <I> _ dcr ^ d 2 $ Q 

3pi dpf ' dpi ds ' dpida ' 

at pi = 0, a = a . (3.7) follows now from Theorem 7.7.18 in [H6r2]. Lemma 3.2 is proved. 

Let us turn now to angular points. So, assume that T is a smooth curve near p° G T and L 
is a straight line which intersects T at p° transversally. Then near p°, T and L divide the plane 
into four parts. Let x(p) = 1 in one of these parts and x(p) = m the remainder. Again we are 
interested in asymptotics of x(0 as |£| ~^ 00 • 

Define the auxiliary functions 

/y 
exp(=pit 2 /2)^, (3.13) 
-oo 

which are C°° bounded functions on R 1 such that 

P±(-oo) = 0, P±(0) = 1/2, P ± (oo) = 1; 



P + (y) = P-(y), P±(y) + P±(-y) = l; (3.14) 

Lemma 3.3. Assume a(p) ^ in vicinity of p° € T and L intersects T at p° transversally. 
Then there exists C°° real valued functions a(a) and b(a) near ao = a(nr(p )) such that a(ao) = 
0,o'(a ) + 0,6(a ) = l"(n r (p )) and 

= ier 3/2 ex P [^|6(a(0) -^]P C (|C| 1/2 aW0))«(«(0) + 0(ier 2 ), */£ G V, (3.15) 

where 4> = (vr/2) + (7r/4) sgno"(p°) ; £ = sgn<j(p ) and u(a) is a C°° function near a with u(ao) = 
^naip )]- 1 / 2 . 

Corollary. If £ £ V and a(£) / ao = a(rir(p )), then 

X(0 - \t\- 3/2 \2ira(O\- 1/2 0(O exp[i(y(0 - <#]| < C|£|- 2 |«(0 - aol" 1 , (3.16) 
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where 9{£) = 1 if3p = p(£) G T with nr(p) = |£| and 9(1;) = otherwise. 



Proof of Corollary. From (3.14), (3.15), we obtain that for a(£) = a / a 
X(0 = l^r 3/2 exp[^|%) - i^](9(0«(a) + 0(|^- 2 |« - aol" 1 ), 
On the other hand, when a(£) = a ^ ao is fixed, Lemma 3.1 proves that 

m = \c\- 3/2 \2MO\- 1 o(o^(Y(o-<p)]+om- 2 ), \t\^°o, uv. 

Comparing these two asymptotics we conclude that the main terms in them coincide, and therefore 
(3.16) holds. 

Proof of Lemma 3.3. Consider a basis ei, e 2 on the plane, where e\ is a unit tangent vector to 
T at p° and e 2 is a unit tangent vector to L at p°. Let e^, be a dual basis, e/- • ej = 5ij, and 
p = p° + Pl ei + p 2 e 2 , £ = Cie- 1 + ^e^. Then 



X(0 = / ^WxW exp(ip£)dp 
Jr. 2 

POO 

= J exp(ip°£)i£- 1 / ^(pi, /(px)) exp(ipi£i + i/(pi)£ 2 )dpi + Oflf | 
Jo 



(3.17) 



-iV\ 



where p 2 = f(pi) is the equation of T and J is the Jacobian. Observe that + /(pi)£ 2 
|£|^(pi;o:(0) where <fr(pi,a) is a C°° real valued function with 

$ _a$_ o d 2 $ 

9pi ' dpf ' dpida ' 

at pi = 0, a = ao- 



By theorem 7.5.13 in [H6r2] there exists a C°° change of variable t = t(pi,a) with t(0, ao) = 0, 

dt 

- — (0,a ) 7^ such that 3>(pi,a) = -((i 2 /2) + K a )> &( a o) = 0, where ( = sgn a(p°). Hence 

<>oo 

J(C) = / ¥>(Pi,/(Pi))exp(i|f|$(pi,a))dpi 

■/ o 

= exp(i|£|6(a)) /"* V(i;«)exp(-^|Ct 2 /2)^dt, 

7t(0,a) dt 

where ip(t,a) = p(pi, /(pi)), Pi =pi(i, a). Observe that ip(t,a) = 1 near (0, ao)- Let 

— = u (a) + tm(a,t) 

Then 

I(£)=exp( i |e|6(a))n (a)|e|- 1 / 2 P c (-i(0,«)|£r /2 ) + O(|£|- 1 ) (3.18) 
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From (3.17), (3.18) we obtain (3.15). Lemma 3.3 is proved. 

Lemma 3.4. Let x(p) = 1 between two rays L l = {p° + Aei, A > 0} and L 2 = {p° + Ae 2 , A > 
0} ; where e\,e 2 are linearly independent vectors, and x(p) = otherwise. Then 

\m\ < citr 1 [(i + \t • eii)- 1 + a + if ■ e 2 \r 1 ] , (3.20) 

and for A — > ±oo ; 

x(Ae J ± ) = C J A- 1 + 0(|A|- 2 ), j = l,2; ^ ■ e 3 - = (3.21) 

Proof. Let p = p° + piei + £>2e2, f = fie^ + ^e^- Without loss of generality we may assume 
that |f 2 1 > |Ci|- Then integrating by parts in p 2 we obtain that 

POO 

x(0 = ^ 2 _1 exp(ip°e) / <p(p u 0) exp(ipifi)dpi + 0(|f r 2 )- 
Jo 

Integrating now by parts in pi we obtain (3.20), while setting fi = we obtain (3.21). Lemma 3.4 
is proved. 

Lemma 3.5. Let x{p) = 1 from one side of the line L = {p° + Ae, A € R} and xip) = from 
the other side of L. Then 

\m\ < C\Z\-\1 + |C • el)" 1 , x(Ae x ) = CA" 1 exp(iAp° • e x ) + 0(|A|" 2 ), |A| oo. 
The proof of Lemma 3.5 is similar to the proof of Lemma 3.4. 
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4. Lattice Point Problem 



Let Z(p) G C°°(R 2 \ {0}) be a C°° positive function homogeneous of degree 2. Define 
N(R) = #{n = (m,n 2 ) G Z 2 : Z(m + (1/2), n 2 ) < R 2 , \n 2 \ < nj, 
tt(i?) ={p£ R 2 : Z(p) < i? 2 , |p 2 | < Pl }, (4.1) 
= AR 2 = Areatt(R). 

The lattice-point problem we are interested in is to evaluate N(R) — A(R) as R — > oo. 
Let 

r = { P GR 2 :Z(p) = l, |p 2 |<Pi}, 

and 2i G T be the endpoints of T with z i = — z 02 > and zn = z\ 2 > 0. For p G T denote by 
nr(p) the vector of outer normal to T at p. Observe that 

nvip) = | gradZ^)!" 1 gradZ(p), 

and 

p • grad Z(p) = 2Z(p) > 0, (4.2) 

hence 

p-n r (p) = 2| grad Z{p)\~ l grad > 0. (4.3) 

Denote by <r(p) the curvature of V at p G T with a sign, so that a(p) > if Q is convex near p, 
<j(p) < if O is concave near p. In what follows we assume the following 

Hypothesis D. (i) a{p) ^ everywhere on V except, maybe, a finite set W = {w\, . . . ,wk}, 
zo, Z\ W, and 

^K)/0, k = l,...,K, (4.5) 

where s is the natural coordinate on T. (ii) V Wk G W the vector = nr(wk) is either rational, 
i.e., n ■ Vk = for some n G Z 2 , or Diophantine in the sense that 3 1 > Q > anc? C > 



_C 

in I 



l niI/ fc| > Tqi+f. VnGZ 2 , n^O. (4.6) 



Without loss of generality we may assume that 

= s(z ) < s(wi) < ■ ■ < s(w K ) < s(zi), 
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(4.7) 



where s(p) is the natural coordinate of p G T. 

We call £ G R 2 \ {0} rational if n • £ = for some n G Z 2 \ {0}. It is to be noted that £ is 
rational iff the set 

L(£) = (z 2 \{o})n{A£, AgR} 

is non-empty. Let 

T ra t = {p G T: nr(p) is rational}. 

For per define 

Y(p)=p-n r (p). (4.8) 

By (4.3) Y(p) > 0. 

Theorem 4.1. Assume Hypothesis D holds. Then 

N(R) = AR 2 + i? 2 / 3 ^ $ fc (i?) +R 1 / 2 F(R), (4.9) 

fc : i^fc is rational 

w/iere &k{R) o-re continuous periodic functions, 
$ k (R) = (l/2)3- 2/3 r(2/3)vr- 4 / 3 

and F(R) G B 2 . The Fourier series of F(R) is 

F(R)=n- 1 %)KP)I~ 1/2 E (-ir|nr 3/2 cos(2vry(p)|n|i?-0(p)), (4.11) 

per rat \W n£L(nr(p)) 

w/iere 

1 if p^Z ,Z!, 

9(p) = 

(1/2) if p = z (h z 1 , 

and (f)(p) = (tt/2) + (tt/4) sgn <r(p). 

We need Theorem 4.1 to prove our main Theorem 1.2. For the sake of completeness we want 
to formulate another theorem which is not needed for the proof of Theorem 1.2, but which is of 
interest by itself. 

Let a G R 2 be a fixed point on the plane. Define 

N(R; a) = #{n G Z 2 : Z(n + a) < R 2 }. 
17 



da 

ds- {Wk) 



- I 



E ( 



n 



-4/3 



sin(2wY (w k )\n\R) (4.10) 



Theorem 4.2. Assume Hypothesis D holds. Then 

N{R; a) = AR 2 + R 2 ^ ^ <f> k (R; a) + R 1/2 F(R; a), 

fc : i/k is rational 

where a) are continuous periodic functions of R, 



<5 fc (i?;a) = (l/2)3" 2 / 3 r(2/3K 



■4/3 



da 

d7 M 



-1/3 



|n|- 4/3 sin(27r(y(u> fc )|n|i?-n-a)) 

n£L(V fc ) 



ano? a) € 5 in R. The Fourier series of F(R; a) is 

F(R;a)=ir- 1 ^ W(p)\~ 1/2 ^ |n|" 3/2 cos(27rr(p)|n|i2 - <j>(p, n, a)), (4.12) 

per rat \VK neL(n r (p)) 

where (j>(p, n, a) = (vr/2) + (vr/4) sgn a(p) + 27rn • a. 

Theorem 4.2 is a generalization of Theorem 1.1 in [Blel] to non-convex domains. 
Proof of Theorem 4.1. N{R) can be written as 

N(R)= x(n + a;R), a = (1/2,0), (4.13) 

neZ 2 

where x(p;i?) is the characteristic function of Q(R). Define for 5 > 0, 

N 5 (R) = Xs(n + a;R), (4.14) 

n£Z 2 



where 

xs(p;R)= ! 5- 2 ^- 1 (p-p'))* , = x(-; j R)*(5- 2 ^- 1 -))(p), (4.15) 

Jn(R) 



and 



p(p) G C °°(R 2 ); ^(p) = ^o(|p|); ¥>(p) > 0; / ^(p)dp = 1; <p(p) = when |p| > 1. 

JR 2 



Lemma 4.3. For T > 1, 

T 



rp 

- [ \N 5 {R)-N(R)\ 2 R- 1 dR<C5T(T- 1 / :i + 5). (4.16) 

L J I 



Proof of this and all subsequent lemmas is given in the next section. For what follows we put 

<5 = T" 1 . (4.17) 
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In this case (4.16) reduces to 

T 



— N(R)\ 2 R~ 1 dR < CT~ 1/3 . 



(4.18) 



By the Poisson summation formula 



N 5 {R)-AR 2 = R 2 ^(2^n5)x(2vrni?)(-l) ni , (4.19) 

nGZ 2 \{0} 



where 



X(0 = / exp(ipOdp, Jl = {?eR 2 : Z(jp) < 1, \p 2 \ < Pl }. 
Jn 

Let us consider a partition of unity on the projective line RP 1 , 

L 

i=i 

and lift it to R 2 \ {0} putting 

H^) = m VA€R 1 \{0}. 

Let 

r« = { P eT:n r (p)e supp^,(0}> 

and Fj l \ j = 1, . . . , «/;, be connected components of r®. Without loss of generality we may assume 
that each contains at most one singular point zq, z\, w\, . . . , wk- 



Then, for a given I consider a partition of unity in the p-plane, 

M 

J]Xm(p) = l, 0< Xm (p)<l, Xm{p) G C°°(f2), 
m=l 

such that for each T^p, 1 < j < J/, 3 a unique Xm(p) which is ^ on . Without loss of 
generality we may also assume that for each m, Xm{p) contains at most one singular point. 



Define 



E lm (R) = R 2 Mn)<p(2TrnS)x m {2TrnR)(-l) n \ (4.20) 

nGZ2\{0} 



where 



Xm(0= / Xm(p) exp(ip£)dp. 
Jn 
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Then by (4.19) 

N 6 (R)-AR 2 = Y,E lm {R). 

l,m 

Now we evaluate E\ m (R) . Let T m = Tn supp Xm ■ 

Lemma 4.4 ( Xm out of r«). IfT m n = i/ten 

sup \E lm (R)\ <C\og 2 T. 

1<R<T 

Next we consider the case when C T m and T m contains no singular point. In this case 
V£ G suppipi 3 a unique G such that rcr(p(£)) = Denote by 

Yo(0=Z-nr(p(0), *o(0 = "(p(0)- 

Lemma 4.5 (regular Xm on T). Assume that z ,zi,wi, . . . ,wk T m and C T m . Then 
E lm (R) = R l / 2 F lm {R), where F lm (R) G B 2 and 

F lm (R) = ir- 1 Yl ^(n)|n|- 3 / 2 |a o (n)|- 1 /2 cos ( 2 ^y o (n) J R-0), (4.21) 

neZ 2 \{0} 

where <p = (vr/2) + (vr/4) sgn a(p), p G T m . 

Assume now that some inflection point Wk lies inside and C T m . Then for every 
£ G suppV'i \ {Az/fcjA G R} two possibilities exist: either 3 two points p±(£) G such that 
n r(p±(£,)) = l^l _1 £) or there is no such point at all. Define the function which is equal to 1 
in the first case, and which is equal to in the second case. For the sake of definiteness we will 
assume that ±a(p±(£)) > 0. Denote by 

Y±(0 = C • n r (p±(0); *±(0 = *(p±(0)- 

Lemma 4.6. ( Xm on inflection point). If = nr(wk) G C T m and Vk is rational then 

Eim (R) = R 2/3 $i m (R) + R 1/2 F lm (R), (4.23) 

where &i m (R) is a periodic continuous function, which is given in (4-10), and Fi m (R) G B 2 . The 
Fourier series of Fi m (R) is 

F lm (R)=K- 1 Y, Yl V'zN^(n)|n|- 3 / 2 |a ± (n)|- 1 / 2 cos(27ry ± (n)i?-0 ± ), (4.25) 

± n€Z 2 \{\vk , AeR} 
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where 4>± = (tt/2) ± (7r/4). 

If Uk is Diophantine then Ei m (R) = R 1 / 2 Fi m (R) where Fi m (R) € B 2 , and the Fourier series 
of Fi m (R) coincides with (4-25). 

Lemma 4.7 (angular Xm)- If n r (z ) € C T m then E lm (R) = R 1 / 2 Fi m {R), where 
Fim{R) £ B 2 , and the Fourier series of Fi m (R) is 

F lm (R)=ir- 1 Yl ^(™)#(™)M" 3/2 Mn)r 1/2 cos(27ry (n)i? -</>), (4.26) 

n£Z 2 \{0} 

where 

1 if n = nr(p) for some p € \ {z }, 
9{n)= (l/2)ifn = n r (*b), (4-27) 
otherwise, 

and <p = (tt/2) + (tt/4) sgn (z ). 

Proof of Lemmas 4.3-4.7 is given in the next section. 

End of the proof of Theorem 4-1- Let us fix I. By Lemma 4.4, 

r-T 



£ lim 1 / \R- 1 / 2 E lm (R)\ 2 dR = 0, 



m: r m nr(')=0 
and by Lemmas 4.5-4.7, 

E lm (R) = R 2 / 3 $iUR) + R 1/2 E F i™{R), 

m-. r m nr(')/0 me/i(i) me/ 2 (i) 

where 

Ji(Z) = {m:3k,j such that w fc G C T m and ^ is rational}, I 2 (l) = {m: T m n r W ^ 0}. 
Making a summation over Z we obtain that if we define 

L L 

^ R ) = Y. E ^rn(R), F(R) = Y J E ^lm{R), 
1 = 1 m€h(l) 1 = 1 mg/ 2 (I) 

then 

lim - / \N S (R) - AR 2 - R 2 / 3 $(R) - R l / 2 F(R)\ 2 R~ 1 dR = 0. 
Lemma 4.3 implies that the same is true for N(R): 

m — / 

T- 



1 r T 

lim - / |iV(i?) - AR 2 - R 2/3 ${R) - R 1/2 F{R)\ 2 R~ l dR = 0. 
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Since F lm (R) £ B 2 , F(R) € B 2 as well (see [Bes]). The Fourier series for and F(R) are the 

sum of the Fourier series for $; m (i?) and Fi m (R), respectively. This proves the formulas (4.11), 
(4.12). Theorem 4.1 is proved. 

Theorem 4.2 is proved in the same way. 
5. Proof of Lemmas 

Proof of Lemma 4-3. We have: 



The support of xs(p',R) — x{P'iR) is concentrated in the (5-neighborhood of d£l(R). Observe that 
dQ(R) consists of the curve RT and two segments [0, Rzq] and [0, Rz\] oriented along the diagonals 
Pi ±p 2 = 0. If S is small, then the 5-neghborhood of [0, Rzq] U [0, Rz\\ does not contain points 
n + a, n G Z 2 , a = (1/2, 0), and it does not contribute to N S (R) - N(R). 



1 Jo 

Observe that Is(n, n') = unless both n + a and n' + a lie in 5-neighborhood of RT for some R, 
hence 3 C > such that 

7 (5 (n,n / )=0, if either \X(n + a) - X(n' + a)\ > C5 or X(n + a)>CT, 

where X(p) = (Z(p)) 1 / 2 . In addition, for all n,n', 



N S (R) - N(R) = Y, (Xs(n + a;R) — X (n + a; R)). 



nez 2 



Now 




where 




h(n,n') < CT^SXin)- 1 < CqT^S^ 



-l 



Therefore 



I < 





-l 




1 



n: X{n+a)<CT 



n': \X(n+a)-X(n'+a)\<C5 



By 2/3-estimate (see, e.g., [CdVl]) 





n': \X(n+a)-X(n' + a)\<CS 
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hence 

I < CiT~M Yl |n| -1 (|n| 2 / 3 + 5\n\) < C 2 5T(T~ 1 ^ 3 + 5). 

n: X{n+a)<CT 

Lemma 4.3 is proved. 

Proof of Lemma 4-4- Let us consider two cases: when E su PPXm(p) and when zq G T m (or 
z\ £ T m ) and T m n = 0; all the other cases are simpler. Due to (4.20), 

Elm = K ^ 
n£Z 2 \{0} 

with 

K{n) = ^(2TTn5)iPi(n)R 2 x m (2TTRn)(-l) n K (5.1) 
By Lemma 3.4, if £ suppXm(p) then 

R 2 \Xm{Rt)\ < Clel" 1 maxjR- 1 + |6 +e 2 |- 1 ,i?- 1 + |6 -6I" 1 }, 
so if n G A, where 

A = {n <E Z 2 : |m + n 2 | > |n x - ra 2 | > 0}, 

then 

R 2 \Xm {2irRn)\ < C\n\- l \ ni - n 2 \~ 1 . 
Therefore Iq = YlneA K{ n ) is estimated as 

Io < \<p(2nn8)\ ■ |n| _1 |ni ~ n 2 \~ l ■ 



Since <p(p) € C^°(R 2 ) 



and 



On the other hand 



\m\<C(l + \t\)- 5 , (5.2) 



Y \<f>(1im5)\ < C , 5 = T" 1 . 

|n|>T2 



E |n| _1 |ni -nsl" 1 < Clog 2 T, (5.3) 

neA, |n|<T 2 

Hence Jo < Clog 2 T. The sum over {|ni — n 2 | > \n\ + n 2 | > 0} is estimated similarly hence we 
obtain 



< Clog 2 T. 
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By Lemma 3.4 



E K(n) = C\R E ^(2vrn<5)^(n)nf 1 (-l) ni +0(1). 



Since and are even functions, 



and thus 



Similarly, 



As a result, 



which was stated. 



E ^(27rn<5)^(n)ni- 1 (-ir =0, 



E K(n) = 0(l). 

n: ni=n2^0 

E K(n) = 0(l). 



\Elm{R)\ 



E 

«ez 2 \{o} 



<Clog 2 T, 



Assume now that zq G T m and Y m C\Y^> = 0. Let Sl be the angle with the vertex at zq and the 
sides which go along [zq , 0] and the tangent vector to r at z , so that Q is a linear approximation 
to Q near z . Assume for the sake of definiteness that a(zo) > 0. Then Q D $7 near jz - Let 



Xm(0 = / Xm{p) ex.p(ip£)dp. 
Jn 



Then 



Xm(0 - Xm(0 = / Xm(p)exp(tJ^)dp. 

is estimated as follows. Integrating in the direction orthogonal to £ we obtain that 

X^(0-Xm(0 = f 1 x m {t)exv(it\ti\)dt, 
where x m (t) is equal to zero in vicinity of t\ and 

X m (i) = oi(i - t ) 2 + a 2 (t - t ) 3 + ... 
in vicinity of to. This implies that |xm^(£) — Xm(£)l — C(l + l£l)~ 3 ; hence 

E (^(n)-^ (0) (n)) = O(^- 1 ), 

n6Z 2 \{0} 
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where 

jf(°)(n) = < p(2imS)$ l {n)R 2 x£ ) {2*Rn)(-l) ni . 

Now, r2 is an angular domain. Using the same arguments as in the case G suppxm, we obtain 
that 

£ K^(n) = 0{\og 2 T). 

neZ 2 \{0} 

This proves that 

sup \Ei m (R)\ < Clog 2 T. 

1<R<T 

Lemma 4.4 is proved. 

We omit proof of Lemma 4.5 and pass now to more complicated Lemmas 4.6, 4.7. Lemma 4.5 
is proved similarly, with some simplifications (see also the proof of Theorem 3.1 in [Blel]). 

Proof of Lemma 4-6- Assume G C T m . Let us split Ei m (R) into two parts: 

E${R)= E E ?2(R)= E K ( n )i (5-4) 

nGZ 2 nL^,n^0 n€Z 2 \L,, 

where K(n) is defined in (5.1) and 

L 7 = {£GR 2 : dist(£,L) < 7 }, L = = Ai/ fc , A € R 1 }. 

with some 7 > which will be chosen later. Let us evaluate E^(R). 

Assume first that i>k is rational. Then we can choose 7 > such that L 1 \L contains no integer 
points. In this case 

Ei%(R)= E ^n6)R 2 x(2nnR)(-ir. 
By Lemma 3.5, if £ € L then 

x(0 = -iexp(iy(0)|£|- 4/3 Ai(0)|(l/2KK)r 1/3 + O(|£|- 5 / 3 ), Ai(0) = 3" 2 / 3 r- 1 (2/3), 
hence 

Ei2(R) = R 2/3 ^ m (R;S)+0(R 1 / 3 ), 

with 

<& Jm (i?;<5) = ^(2vrn,5)(-i)sin(2^y(n) J R) x |2H~ 4/3 Ai (0)|(l/2)a>,0r 1/3 (-l) ni . 

nCL(v k ) 
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Since 

oo 

|1 - <p(2irqr5)\q- 4 / 3 < C5 1 / 3 = CT~ X I\ 

we obtain that 

^W (j R) = ^^(i?) + 0(^/3 + jR 2/3 T -l/3 )) 

where 

d>, m (i?) = (l/2)3- 2 / 3 7r- 4 / 3 r- 1 (2/3)|a'K)|- 1 / 3 (-l) ni |n|- 4/3 sin(2^y( 

nGL(i/ fc ) 

is a periodic function of R. 

Assume now that v k is Diophantine, 

\n-v k \ > C|n|- 1_c , 0<C<1- 

In this case we put 7 = 1. Define 

raeZ 2 nLi,0<|n|<AT 

Let us prove that 



sup R-^E^R) - E^{R-N)\ < CN«-W 

l<_R<oo 



'/m (^) ~ ^/m < 

Indeed, |Ai(y)| < C| — 1 / 4 and |afc(a)| > Co\a — a(u k )\, hence (3.7) implies that 

\Xm(0\<C\^\- 3 / 2 HO-a(u k )\-^ 

and 

\K{n)\ < CR^ 2 \n\- 3 / 2 \a{n) - a{v k )\-^\ 

Therefore 

n£Z 2 nLi, n|>iV 

<C ^ |n|" 3 / 2 |Q(n) -aK)!" 1 / 4 . 

n6Z 2 nLi, n|>JV 

Due to the Diophantine condition (5.7), 



\a(n) -a(u k )\ > C\n\~^\ 
26 



Let J > N. Order all n € Z 2 n L\ with 1 < \n\ < 2J and n ■ u k > in the increasing order of 
\n ■ v k \ = \n 2 Vki ~ n x v k2 \: 



\rS^ • v k \ < |ra( 2 ) ■ < . . . 

Then (5.7) implies that 



InW -i/fcl > C J- (1+C) 

and 



|n«+i) • i/ fc | > |n0) • !/ fc | + C J- (1+C) , i > 1, 

so that 



\n^-v k \ >C jJ- (1+c) , 

hence 

|a(n^)-«K)l >diJ-( 2+c ) 

and 

2 |n|- 3 / 2 |a(n) -aK)|" 1/4 < CJ" 3 / 2 j( 2 +<^ 4 ^ j" 1 / 4 < dJ^" 1 )/ 4 . 

n€Z 2 nLi, J<|n|<2J .7 = 1 



This implies 



|n|- 3 / 2 |a(n) - a^)!" 1 / 4 < CN^/\ 

n6Z 2 flLi, jV>|n| 



(2) 

and hence (5.8) follows from (5.9). Let us evaluate now E\J i (R). 
From (3.9) 

\E?2{R) ~ Et m {R) - E~ m {R)\ 



< CR 2 Mn)\<P( 2 *n*)\ ■ \Rn\- 5/2 \a(n) - a(i/ fc )|" 7/4 (5,11) 



n£Z 2 \L 1 

where 



n€Z 2 \L 1 



and 



K^n) = R 1/2 7r- 1 MnM27m5)e(n)\n\- 3 / 2 \a ± {n)\- 1 / 2 {-l) ni cos(2irRY±{n) - <f>±). (5.12) 
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The RHS in (5.11) is estimated as follows. Let d(£) = dist(£,L). Then 

RHS < CR~ 4 I 2 Mn)\v{^n5)\-\n\- 5 / 2 d(n)- 7 / 4 \n\ 7 / 4 

n€Z 2 \L 7 

= CR- 1 ' 2 Mn)\v{^n5)\-\n\- 3 / 4 d(n)- 7 / 4 . 

n€Z 2 \L 7 

Since for p = 1, 2, . . . , 

Y Mn)d(n)- 7 / 4 < C, 

neZ 2 \L 7 , p<\n\<p+l 

and 



sup \<p(2im6)\ < C(l+p5)- 5 , 

p< |n| <p+l 



we obtain 



RHS < CR- 1 ' 2 £(1 + p5)" V 3/4 < CoR-^S- 1 ' 4 = CoR-^T 1 / 4 , 
P =i 

so that 

\E%(R) ~ E+ m (R) - Ef m (R)\ < CR-^T 1 / 4 . (5.13) 

Define 

fL(R) = r- 1/2 eL(R) = r- 1/2 E 

n£Z 2 \L 7 

n£Z 2 \L 7 , |n|<Ar 

The central point in our proof is 



Lemma 5.1. For all N,T > 1, 

r 

T 



fJo \ F t(R)-Ft(R;N,6)\ 2 dR<C(N- 4 / 3 + T- 4 / 4 ), 8 = T~ 4 . 



(5.14) 



We will give the proof of Lemma 5.1 below, in the end of this section, and now let us derive 
Lemma 4.6 from Lemma 5.1. 

Assume that Vk is rational. Define 

F lm (R) = R~ x /\E lm {R) - R 2 '^ lm (R)) 

with $i m (R) given in (5.6). Then by (5.5) 

F lm (R) = R- l / 2 E\ 2 2(R) + OiR- 1 / 6 ), 1 < R < T, 

28 



and by (5.13) 

R-^E^iR) = F+ (it>) + F~ m (R) + O^T 1 ^), 1 < R < T, 

so that 

Fim(R) = F+ m (R) + Fr m (R) + OCR" 1 / 6 + i?" 1 ^/ 4 ), 1 < -R < T, 
which implies that 

lim 1 / |F, m ( J R)-F+(«)-F ; -( J R)| 2 d J R = 0. (5.15) 

Define 

n£Z 2 \L 7 , n|<iV 

where 

if ± (n) = 7r-V/(n)0(n)|n|- 3/ V±(«)r 1/2 (-l) ni cos(2^RY±(n) - <j>±). (5.16) 
Observe that F^R; N) is a finite trigonometric sum, hence 

\F±(R;N,8)-F±(R-,N)\ < C(N)5 = C^T" 1 . 

Therefore Lemma 5.1 implies that 

hmsnpi / \F±(R) - F±(R;N)\ 2 dR < CN^, 

hence from (5.15) we deduce that 

hmsupi f \Fi m (R) — F^ n (R;N) — F^ n (R; N)\ 2 dR < CN~ X ^. (5.17) 

This implies that Fi m (R) <G i? 2 and (4.19) is the Fourier expansion of Fi m (R). For rational 
Lemma 4.6 is proved. 

In the case of Diophantine we define F\ m (R) = R~ 1 / 2 Ei m {R). Then 

F lm (R) = F^(R)+F^(R), F^(R) = R-^E^(R), j = 1,2, 
and similarly to (5.17) we have that 

lim sup 1 / 1^(12) -F+^JVJ-Fj-^JVJpdR^CJV-Vs ( 5 .18) 

T^oo J JO 

with F^ n {R; N) defined in (5.16). 
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Then, (5.8) implies that 

T 

limsupl/ \F^(R)-F^(R;N)\dR<CN^/\ (5.19) 

T^oo 1 JO 

where 

F^(R;N) = R 3 / 2 MnM27rnS)x(27TnR)(-l) n K 

n€L y , 0<\n\<N 

This is a finite sum and from (3.9) we obtain that 

\F^(R;N) - F+ (R;N) - F^(R;N)\ < C(N)(R~ 1 + T -1 ) (5.20) 

with 

raeZ 2 ni 7 , 0<|n|<JV 

It follows from (5.18)-(5.20) that 

limsup^ f \F lm (R) - F+^R-N) - F+(R;N) 

T^oo J- Jo 

- Ff m {R-N) - Fr m (R;N)\ 2 dR < CN^'\ 
which proves Lemma 4.6 for Diophantine V}.. 

Proof of Lemma 5.1. To simplify notations we will omit ± in sub- and superscripts. From 
(5.12) and (5.14) 

\\ \F lm (R)-F lm (R;N,5)\ 2 dR = 7T- 2 M^M*') 

J ° n,n'eZ 2 \L 7 ; \n\,\n'\>N (5.21) 

(^(27rn,5)^(27rn , <5)^(n)^(n0|nr 3/2 |n , r 3/2 |a(n)| 1/2 |a(n / )| 1/2 /(n,n / ), 

where 

rp 

I(n, n') = l- [ cos(2irY(n)R - </>(n)) cos(2^Y (n')R - </>(n'))dR. 
T Jo 

Observe that 

\I(n,n')\ < min{l, T" 1 ^^) -y^OI" 1 }. (5.22) 

In addition, 

\(p(2Trn5)\ < C*(l + Y(n)5y 5 , C\n\ < Y(n) < C'\n\, 
and the RHS of (5.21) is symmetric in n, n'. This implies that 

\l \F lm (R)-F lm (R;N,5)\ 2 dR<C £ H(n,n') (5.23) 
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with 

H(n,n') = Mn)M^')^ + y(.n)S)- 5 d(n)e{n r )Y(n)- 3 / 2 Y(n')- 3 / 2 
\a(n)\- 1/2 \a(n')\- 1/2 min{l, T" 1 {Y{n) -y(n'))" 1 } 
and j3 > 0. First we estimate J2( n n')eS(N) H(n,n') with 

5(iV) = {n,n' e Z 2 \ L 7 ; y(n) > y(ra') > F(n) - y(n') > 1}. (5.24) 

Let us fix some n with Y(n) > (3N and define the layers 

S(N,n,j) = {n': n' G Z 2 \L 7 ; y(n') > 0N; j + 1 > Y(n) - Y(n') > j}, 

l<j< Y{n) - 0N. 

Observe that |c(n)| < C\a(n) — a{yk)\~ x l 2 , hence 

£ Mn')0(n')\a(n')\ 1/2 < C Area S{N, n,j) < C (Y(n)-j) 

n'eS(N,n,j) 

and therefore 

Mny(n')\a(n')\ 1/2 Y{nY 3/2 T-\Y(n) -y(n'))" 1 

n'eS(N,n) 

Y(n)-1 

<C (Yi^-jr^T-'j- 1 ^CoT-'Yinr^logYin), 

i=i 

where S(N,n) = \JjS(N,n,j). Making a summation in n we obtain now that 

H{n,n!)<CT- x Yl Mn)(l + Y(n)5)- 5 

(n,n')eS(N) n€Z 2 \L y ;Y(n)>(3N 

x y(n)- 2 logy(n)| CT (n)r 1/2 . 
Define the layers 

S, = {n G Z 2 \ L 7 , j < Y(n) < j + 1}, j > f3N. 



Then 



hence 



Y Mn)0(n)\a(n)\- 1/2 < CAreaS 1 , < C j, 

neSj 



H(n, n') < CT- 1 £ (1 + j<5)- 5 r 1 log j 

(n,n')eS(AT) j=/3N 

^CoT-^log^l 2 = C T- 1 log 2 T. 
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(5.25) 



It remains to estimate Yl( n n')eS (N) H( n -> n ') where 

S (N) = {n, n' G Z 2 \ L 7 ; Y(n) > Y(n') > 0N; 1 > Y(n) - Y(n') > 0}. 

Let us fix some n with T > Y(n) > [3N. Define the layers 

S {N,n,j) = {n' G Z 2 \ L 7 : Y{n') > fiN; (j + l)T~ l > Y(n) - Y{n') > jT" 1 }, 

j = 0,l,...,T. 

To estimate the sum over Sq(N, n,j) we use the following 
Lemma 5.2 (2/3-estimate). Let 

no = iei/(KO-«oi 1/2 ), (5.26) 

where f(t) G C°°([0,e]), £ > 0, f(t) > 0, /'(0) = 0, /'"(0) ^ 0. Then ifif>(a) G C°°([a - 0, a + e]) 
with suppip(a) near a® then 

|-l/2 < CR 2/^ (5 _ 2?) 

nen(fi), dist(n,L)>l 

w/iere 

U(R) = {n G Z 2 : a < a(n) < a + e; i? < Y(n) < i? + iT 1/3 } 

anc? L = {£ : a(£) = «o}- 

Remark. If we step away from ao putting ao + £o < a(n) < a + e, £o > 0, in H(R) (instead 
of a < a(n) < «o + e) 5 then (5.27) reduces to a well-known 2/3-estimate (see, e.g., [CdVl]). 

Proof of Lemma 5.2 is given in Appendix to the paper. 

With the help of Lemma 5.2 we obtain that if T 3 > Y{n) then 

^(n')0(n')Kn')r 1/2 < CF(n) 2/3 

n'eS (N,n,j) 

(observe that Kn')|- 1/2 < C\a(n') - a(i/ fe )l~ 1/4 < C\a{n') - a^)]" 1 / 2 ), and 

^(^^(nOk^or^y^-^mini^r-^y^-y^'))" 1 } 

n'eS (N,n,j) 

<CY{n)- 3 / 2 Y(n) 2 / 3 T- 1 j- 1 Y(n) = CY(n) 1 / 6 T- 1 j-\ if T > j > 2, 
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and < Cy(n)" 5 / 6 if j = 0, 1. Hence 

J2 i/fi(n')9{n')\(T(n')\- 1 / 2 Y{n')- 3/2 min{l, T" 1 ^^) -y(n'))" 1 } 

n'£S (N,n) 

< CiYinf^T- 1 log T + y(n)" 5 / 6 ), 

where 

S (N, n) = {ri € Z 2 \ L 7 : Y(n') > (3N; 1 > Y(n) - y(n') > 0}. 
Making a summation over ra, we obtain 

£ H(n,n')<C Yl Mn)(l + Y(n)S)- 

{n,n')eS {N); Y(n)<T^ n€Z 2 \L y ; T3>Y(n)>f3N 

0(n)y(n)" 3/ V(n) T 1/2 (y^) 1 /^" 1 log y(n) + y(n)" 5/6 ) = CJ . 
Consider the layers 

S 1 , = {n G Z 2 \ L 7 , j + 1 > y(n) > j}, T 3 > j > 0N. 
The width of is of order of 1, and a simple argument shows that 

Y, MnW(n)W(n)\- 1/2 <Cj. 

neSj 

This implies 

i <cJ2 (i+jsy'r^ju^T-Hogj +r 5/6 ) 

< Co^'^llog^lT- 1 + iV- 1 / 3 ) = ^(T-^^ogT + iV- 1 / 3 ). 

Thus 

^ tf(n,n') < C(T- 1 / 3 logT + iV- 1 / 3 ) 

(n,n')6So(JV); Y(n)<T 3 

The final step is to estimate 

(n^OeSoCW); y(n)>T 3 

and this is quite simple. Since for (n,n') £ So(N), 

H{n,n') < C(l + y(n),5)- 5 y(n)- 3 | CT (n)r 1 / 2 |a(n / )r 1/2 

and 

2 |c7(n')r 1/2 <cy(n), 

n': F(n)>y(n')>y(n)-1; n'^L 7 
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we obtain 

E H ^ n ') 

(n,n')eS (N); Y{n)>T^ 

<C Y, (l + Y(n)5)- 5 Y(n)-*\a(n)\- 1/2 

{n,n')eS (N);Y(n)>T3 ^ > 

oo 

<C ^(l+jij^^iT- 2 . 

j=T 3 

From (5.23), (5.25), (5.28) and (5.29) Lemma 5.1 follows. 

Proof of Lemma 4-7. The proof of Lemma 4.7 is similar in main steps to the proof of Lemma 
4.6. Assume v = n r (z ) G rf ] cT m . By (4.15) 

F lm {R)= K ( n )- ( 5 - 3 °) 

n£Z 2 \{0} 

with 

K{n) = R 3/2 ^(2TTn5)ipi(n)xm{2TTRn)(-l) ni 

Define 

L = {Az^o, A G R}, Li = {n G Z 2 : dist (n, L) < 1}, 
= E = E *M 

so that F Iro (fl) = F«(i?) + ^(i?). By (3.15) 

\K(n)\ < C\n\~ 3 / 2 , 

hence 

Y \K(n)\ < CN- 1 / 2 . (5.31) 

n€L 1 , \n\>N 

Define 

K (n) = ^- 1 |nr 3/2 ^(2^n5)|a o (n)|- 1 / 2 0(n)cos(27ri?y o (n) -0). (5.32) 

By (3.18) 

J2 \K(n)-K (n)\ 

ngLi, \n\>N 

<CR~ 1/2 Yj |^(27rn(5)| • |n|- 2 |a(n) -ao| _1 < i?" 1/2 log 2 T. 

n&Li, \n\>N 

The following lemma holds: 
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(5.33) 



Lemma 5.3. For all N,T > 1, 



1 

T Ji 



ngL-L, \n\>N 



dR<C{N~ 1 ^ + T" 1 / 4 ). 



The omit the proof of this lemma since it basically the same as the proof of Lemma 3.3 in 
[Blel] (see also the proof of Lemma 5.1 above, where a similar statement was proved in a more 
complicated situation). 



Lemma 3.3 implies that for a fixed n£Z 2 \ {0}, K(n) converges to K (n) as R — > oo, hence 

2 

dR = 0, 



and by Lemma 5.3, 



This proves Lemma 4.7. 



lim — , 

T^oo T J 1 



lim — , 



E cw-^oW) 

0<|n|<iV 



0<|n|<iV 



di? = 0. 



6. Energy Levels and Closed Geodesies 



In this section we prove Theorem 1.2. Let 

N(R) = #{E n < R 2 }, N BS (R) = #{n G Z 2 : Z 2 (m + (1/2), n 2 ) < R 2 , |n 2 | < m} (6.1) 



and 

r = { P GR 2 : Z 2 (p) = l, \P2\ <Pi}- 
Recall that DH is defined by (1.12) and Hypothesis D by (4.5), (4.6). 

Lemma 6.1. DH implies Hypothesis D for T. 

Proof. By (2.4) V is the graph of the function 

,6 

Pi=9ijP2) = \P2\+^- 1 / (l-p2/- 2 (s)) 1/2 tfc, /(a) = /(6) = |p 2 |, |D2|</n 
y(p 2 ) is an even C°° function, so we will assume p 2 > 0. The function 

^ = 1 " vr- 1 f P 2f-\s)(l - P 2 f- 2 (s))- 1/2 ds 

dP2 J a 
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(6.2) 



(6.3) 



(6.4) 



has a nice geometric interpretation. 
Proposition 6.2. 



dpi 
dp 2 



= I > 0. (6.5) 

P2=I 



Proof. An equation of 7(7) is 



^ = /r 2 («), ^ = (i-/ 2 r 2 ( s )) 1/2 , (6.6) 



where I is the normal coordinate on 7. Hence 



r/s //- 2 ( S )(l-/ 2 /" 2 ( S ))- 1/2 



and 



w(i) = 7r_1 / Ts ds ~ l = i: ~ 1 S a ir\s){i-fr\s))-^da-\. 

Comparing this with (6.4) we obtain (6.5). Proposition 6.2 is proved. 

Observe that an inflection point on V is characterized by - 2 = 0. By (6.5) this is equivalent 
to uj'(I) = 0. Similarly, the nondegeneracy of the inflection point is characterized by u/'(7) 7^ 0. In 
addition, the Diophantine condition (4.6) is equivalent to (1.12), hence DH implies Hypothesis D. 
Lemma 6.1 is proved. 

Lemma 6.1 implies that Theorem 4.1 holds for Nbs(R)- Our goal now is to find geometric 
interpretation of frequencies and amplitudes in formulas (4.11) (4.12). 

Consider a finite geodesic 7 which starts at x = (s max ,0) at some angle — tt/2 < a < tt/2 to 
the direction to the north. 7 is uniquely determined by I = sin a and I = 7 = 7(1, 1). Let G be 
the set of all 7(7, 1), -1 < I < 1, I > 0. 

Assume that T is defined as in (6.3). Define two maps: 

p:G ^T, £:G^R 2 \{0}, (6.6) 

where 

p . 7 = 7(7, l) _p( 7 ) = ( 5 (7),7), £: 7 = 7(^,0 -£(7) = (/t-V),^)^- 1 ^)). (6.7) 



Proposition 6.3. 77(7) and £(7) satisfy 

«r(p(7)) = ie(7)r 1 e(7) 
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(6.8) 



and 



p( 7 )^(7) = (27r)- 1 | 7 !. 



(6.9) 



Proof. (6.5) implies that nr(p( 7 )) is collinear with the vector (l,w(7)) as well as £(7), hence 
(6.8) follows. To prove (6.9) observe that the both sides of (6.9) depend linearly on | 7 |, so it is 
sufficient to prove (6.9) in the particular case when | 7 | = r(J). In this case (6.9) reduces to 

g(I)+Ir(I) = (2vr)- 1 r(/). (6.10) 

Since 

g (I) = I + vr- 1 f\l - / 2 /- 2 ( 5 )) 1/2 ^, u,(7) = vr- 1 f If- 2 (s)(l - I 2 f- 2 {s))-^ds - 1, 

J a J a 

and by (6.6) 

r(7) = 2 jf " ^cfa = 2 J\l - I*f-\s))-^ds, 
(6.10) follows. Proposition 6.3 is proved. 
(6.8) implies that 

£(7) G L+(n r (p(7)) = {An r (p(7)), A > «}• 
Hence we can define the map 7r: G — > iV+r, where 

iV + r = U pe ri+(nr(p)), 

as 7r: 7 — > (p( 7 ), £( 7 ))- Observe that tt is one-to-one. 

Proposition 6.4. 7 € G is a closed geodesic iff £ Z 2 . In this case 

np(7))l^7)! = (2vr)- 1 |7|, (6.11) 
k(p(7))|- 1/2 |^(7)|- 3/2 = ^(iT^Mlf^hr 3 ' 2 , (6.12) 
sgncr(p( 7 )) = sgnu/(7), 7 = 7 (7,Z). (6.13) 

Proof. Observe that 7 (J, /), 7 / 0, is a closed geodesic with ni revolutions around the axis 
and n 2 oscillations along the meridian iff I = | 7 | = n 2 r(7) and a; (J) = (n 1 /n 2 ) — 1, so that 
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£(7) = {n2,ni — n 2 ) € Z 2 . Similarly, 7 = 7(0, 1) is a closed geodesic iff I = \^\ = n 2 r(I), so that 
£(7) = ( n 2, 0). This proves the first part of Proposition 6.4. 

To prove (6.11) let us notice that ^(p(7))|£(7)| = p(j) ■ £(7), hence (6.11) follows from (6.9). 
Let us prove (6.12). We have: 

- ' f{1) 



(i + (sW) 3/2 ' 

and since g'(I) = —co(I), 

'<*>» = (TT^§W ( " 4) 

On the other hand, by (6.7) 

\m\ = |7|r(/)- 1 (l+c(/) 2 ) 1 / 2 , 

hence 

k(p(T))|- 1/2 |e(T)r 3/2 = k'WI-^^l+^U) 2 ) 3 / 4 ^!- 3 / 2 ^^) 3 /^^^^) 2 )- 3 / 4 

= |^(/)|- 1 /2 T (/)3/2| 7 |-3/2_ 

(6.12) is proved. (6.13) follows from (6.14). Proposition 6.4 is proved. 

Proof of Theorem 1.2. From Lemma 6.1 and Theorem 4.1 we obtain that 

N BS (R) = AR 2 + R 2 ^ Yl ®k(R)+ R 1/2 F(R) , 

k: nr(wk) is rational 

where 3>fc(i2) are periodic continuous functions and F(R) € B 2 . In addition, the Fourier series of 
$>k(R) and F(R) are given in formulas (4.11) and (4.12), respectively. From Theorem 2.1 we obtain 
now that 

N(R) = AR 2 + R 2 / 3 J2 ®k(R) + R 1/2 F(R), 

k: rar(uifc) is rational 

where 

lim 1 f \F(R)-F(R)\ 2 dR = 0. 

This implies that F(R) € B 2 as well and the Fourier series of F{R) and F(R) coincide. If we 
substitute formulas of Lemma 6.4 into (4.11), (4.12) we obtain (1.14), (1.15). Theorem 1.2 is 
proved. 
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Appendix. Proof of Lemma 5.2 



For the sake of definiteness we will assume that f"'(0) > 0. Let T* = {Y(£) = 1} n {a < 
«(£) < cto + e} and £° = T* n {«(£) = Qo}. Consider a basis ei, e<i on the plane such that e\ = £° 
and 62 is parallel to the tangent vector to T* at £o ( see Fig-6). In the basis ei,e2 the equation of 
r* has the form & = /i(£a /2 ), where /i(t) e /i(0) = 1, /i'(0) = /i"(0) = 0, ti"(0) > 0. Let us 
choose the length of e 2 in such a way that h"'(0) = 2, so that h(t) = 1 + i 3 /3 + . . . for small t. Let 
ej^, be a dual basis to ei, e 2 . Let < A(t) < 1 be a C°° function on a line which is equal to 
near 0, and which is equal to 1 when t > 1. 

We will show that 



where nf = n-ef,j = 1,2. Observe that |o:(£) - ao|~ 1/2 < C |£2~| _1/2 .R 1/2 when f G II(i?), hence 
from (A.l) Lemma 5.2 follows. 



Let QfcR) = H&MR-'&Mr 1 ' 2 , and Q (£;#) = Q(£fl) if £ € U(R) and Q (£;#) = 




(Al) 



z 2 nn(R) 



otherwise, so that 



I(R)= Y, Qo(n;R). 



nez 2 



Let 




Q( m R)S- 2 V (5- 1 (^ - V ))dr, = Q (-; * (r r V(« _1 -))(0. * > 0, 



where ip(£) £ C£°(R 2 



), <p(£) > 0, <p(S) = if |£| > 1 and J R2 ^(Ode = 1, and 



/ 5 (i?) = Y Qs(n;R)- 



n€Z 2 



Put 



5 = R- 1 / 3 . 



(A2) 



Observe that 



Qo&R) <CQs(£;R), 



so < CIs(R) and to prove (A.l) it is sufficient to show that 



Is(R) < CR 1/6 . 



(A3) 
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By the Poisson summation formula 



I S (R)= ^ <p(2im6)Q(2irn;R). (AA). 

n£Z 2 



The term n = is 

Q&RH^CR- 1 / 3 

I(R) 



Q(0;R) = [ Q&R)d£ < CR~^ [ \&\~ 1/2 d& < C^R 1 '^ 

JU(R) JO 

hence we may consider only Let Pi = p ■ ei, p 2 = p • e 2 . If p 2 > l\pi\, 7 > 0, then 

Q(p;R)= f Q(£;fl)exp(ipe)de (A5) 
Jn(R) 

can be estimated in the following way. 

First we integrate in (A. 5) by the lines ■ £ = c and then in c, so that 

/oo 
exp(i\p\c)S(c; R)dc, 
-oo 

where 

S(c;R) = I K&mR- l &)\&\- 1,2 dt. 
Vn(fl)n{|p|- 1 P |€l=c} 

If e <C 7, then the lines \p\~ 1 p • £, = c cross II(i?) transversally, which implies that 

S(c; R) = R-^Xoic - c )MR~\c - c ); R)\c - c |- 1/2 , 

where cq = R\p\~ x p ■ £°, \o(t) G C°°, Ao(t) = in vicinity of 0, and \o{t) = 1 in vicinity of oo and 
ipo(t;R) € Co°([0, oo)) has a limit in C^°-topology as R — > oo. Therefore 

|Q(p;i2)|< CiT 1 / 3 ^" 5 

and 



Q(27rn;i?) 

n: |n-e 2 | >7|n-ei | , n^O 



< C7T 1/3 . (A.6) 



The main difficulty is to estimate Q(p;R) when \p 2 \ < 7Pi,7 > 0. We have: 

/* OO 

Q(p;R) = J dte-x.-p{ip 2 t)\(t)il){R- 1 t)t- 1/2 I ds exp(ipis), 

■/ Ja 

* = s = £iS a = / l (t 1 / 2 ;i?), b = h(t;R + R~ 1 / s ), 
40 



(A7) 



where J is Jacobian and h(t;R) = Rh(R 1 t). Let 

Qo(p;R) = J / dtex.p(ip 2 t)ip(R~ 1 t)t~ 1 / 2 / ds exp(ip 1 s), 
Jo J a 

The difference Qi(p; R) = Qo(v, R) — Q(p~, R) can be estimated as follows. 



Observe that 



dtexp(ip 2 t)(l - \(t))ilj(R- 1 t)t- 1/ ' 2 



<c(i+ P2 )- 1 / 2 , 



hence 



and 



\Qi(j>:R)\ <C(1+ P2 )- 1 / 2 R- 1 / 3 



Qi{2itn;R) 

n: \n-e2 \ <j\n-ei | , n^O 

< c ir 1/3 <r 3 / 2 = c r 1/6 . 



<C7T 1/3 |£(27m<S)|(l + |n-e 2 |)- 1/2 



(A8) 



Thus it remains to estimate a similar sum with Q (27m; R). 

Let us integrate in s in (A. 8) and make the change of variable u = (i? -1 ^) 1 / 2 . This gives 

Q (p; R) = 2J(ip 1 )- 1 R 1 / 2 (W(p; R) - U(p; R)) , 



where 



U(p;R)= / duex.p(iRp 2 u 2 )^(u 2 ) exp(iRpih(u)), 
Jo 

POD 

W{p;R) = / duexp(iRp 2 u 2 )ip{u 2 )exp[iR(l + R- 4/3 ) Pl h((l + R- 4/3 )u)]. 
Jo 



Let us evaluate first 



(A9) 



/•CO 

U(p;R)= duexp[iR Pl (yu 2 + h{u))]ip{u 2 ), y = p 2 / Pl . (A10) 
Jo 

dT dT 

There exists a C°° change of variable T = T(u,y) such that T(0) = 0, — — (0) = — — (0) = 1 and 

ou ay 



yu 2 + h(u) = b(y) + a(y)T + T 3 /3, 

where a(y),b(y) € C°°, a(0) = 6(0) = (see [H6r2]). In addition, 

a(y)+T 2 (0,y) =0, 
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(All) 



which follows if we differentiate both sides of (A. 11) at u = 0. After this change of variable U(p; R) 
reduces to 

U(p;R) = exp(iR Pl b(y)) / exTp(iRpi(—c 2 (y)T + T /3))ipo(T, y) — (T, y)dT, (A12) 

Jc{y) OL 

with c(y) = T(0,y) and ^ (T,y) = ip(t 2 (T,y)). Following [H6r2] let us divide (du/dT)(T,y) by 
—c 2 (y) + T 2 with a remainder: 

— (T, y) = r(T, y)(-c 2 (y) + T 2 ) + r (y) + ri (y)T. 

Then the first term after substitution into (A. 12) allows integration by parts, which gives an extra 
(i?Pi) _1 , and the other two terms give the main contribution to U(p;R): 

U(p;R) = eMiRPiKyVliRPir^ViciyXRp^roiy) + (Rpi)- 2 ^VMv){RPi) 1/3 )ri{v)} 
+ 0((R Pl )- 1 ), 

(A13) 

where 

f'CO f'OO 

V(x)= exp[i(-x 2 T + T 3 /3)]dT, V (x) = / Texp[i(-x 2 T + T 3 /3)]dT. 

J X J X 

The method of stationary phase gives the asymptotics of V(x), Vq{x) when \x\ — > oo, and from this 
asymptotics we obtain \V(x)\ < C(l + \x\)- x / 2 and \V (x)\ < C(l + |x|) 1/2 . Therefore 

<<7|# Pi r 1/3 mm{l,(|^^^ 

A similar estimate holds for W(p; R) and finally we obtain 

\Qo(p;R)\ ^Clpxl-^inl^r 1 / 2 ,^ 1 / 6 ^!- 1 / 3 }. 

Hence 



^(2vrn5)Q (27rn : R) 

\n-e2\<l 



<CR^ & l"- e i!" 4/3 <CoR 1/6 , 

|n-e 2 |<l 



and 



^2 <p(2irn5)Q (2iTn : R) 

K|n-e 2 |<7|n-e 1 | 

< Cod- 1 / 2 = CoR 1 / 6 . 
Lemma 5.2 is proved. 



<C Y \¥(2irn5)\\n-e 1 \- 1 \n-e 2 \- 1/2 

K|n-e 2 |<7|n-e 1 | 



Acknowledgements. The author thanks Freeman Dyson, Dennis Hejhal and Peter Sarnak for 
useful discussions of the paper. This work was done at the Institute for Advanced Study, Princeton, 
and the author is grateful to IAS for financial support during his stay at the Institute. The work 
was also supported by the Ambrose Monell Foundation. 

42 



References 



[Ber] P. H. Berard, On the wave equation on a compact Riemannian manifold without conjugate 
points, Math. Z., 155, 249-276 (1977). 

[Bes] A. S. Besicovitch, Almost periodic functions, Dover Publications, New York, 1958. 

[Blel] P. M. Bleher, On the distribution of the number of lattice points inside a family of convex 
ovals, Duke Math. Journ. 67, 3, 461-481 (1992). 

[Ble2] P. M. Bleher, Distribution of the error term in the Weyl asymptotics for the Laplace operator 
on a two-dimensional torus and related lattice problems, Preprint, Institute for Advanced 
Study, IASSNS-HEP-92/80, 1992 (to appear in Duke Math. Journ.). 

[BCDL] P. M. Bleher, Zh. Cheng, F. J. Dyson and J. L. Lebowitz, Distribution of the error term for 
the number of lattice points inside a shifted circle, Preprint, Inst. Adv. Study, IASSNS-HEP- 
92/10, 1992 (to appear in Commun. Math. Phys.). 

[BL] P. M. Bleher and J. L. Lebowitz, Energy-level statistics of model quantum systems: universal- 
ity and scaling in a lattice-point problem, Preprint, Inst. Adv. Study, IASSNS-HEP-93/14, 
1993. 

[CdVl] Y. Colin de Verdiere, Nombre de points entiers dans une famille homothetique de domaines de 
R n , Ann. Scient. Ec. Norm. Sup., 4 e serie, 10, 559-576 (1977). 

[CdV2] Y. Colin de Verdiere, Spectre conjoint d'operateurs pseudo-differentiels qui commutent. II. Lc 
cas integrable, Math. Z., 171, 51-73 (1980). 

[DG] J. J. Duistermaat and V. W. Guillemin, The spectrum of positive elliptic operators and periodic 
bicharacteristics, Inventiones math., 29, 39-79 (1975). 

[Harl] G. H. Hardy, The average order of the arithmetical functions P(x) and A(x), Proc. London 
Math. Soc, 15, 192-213 (1916). 

[Har2] G. H. Hardy, On Dirichlet's divisor problem, Proc. London Math. Soc, 15, 1-25 (1916). 

[HR] D. A. Hejhal and B. Rackner, On the topography of Maass waveforms for PSL(2,Z): experi- 
ments and heuristics, Preprint, University of Minnesota, UMSI 92/162, 1992. 

[Hla] E. Hlawka, Uber Integrate auf konvexen Korpern. I, Monatsh. Math., 54, 1-36 (1950). 

43 



[Horl] L. Hormander, The spectral function of an elliptic operator, Acta Math., 121, 193-218 (1968). 

[H6r2] L. Hormander, The analysis of linear partial differential operators. I. Distribution theory and 
Fourier analysis. Springer- Verlag, Berlin e.a., 1983. 

[Hux] M. N. Huxley, Exponential sums and lattice points. II. Preprint, University of Wales College 
of Cardiff, Cardiff, 1992. 

[Lan] E. Landau, Vorlesungen iiber Zahlentheorie, Chelsea, New York, 1969. 

[LS] W. Luo and P. Sarnak, Number variance for arithmetic hyperbolic surfaces, Preprint, Princeton 
University, Princeton, 1993. 

[Ran] B. Randol, A lattice-point problem, Trans. Amer. Math. Soc. 121, 257-268 (1966). 

[Sar] P. Sarnak, Arithmetic quantum chaos, Schur Lectures, Tel Aviv, 1992. 

[Sie] W. Sierpinski, Oeuvres Choisies, Vol. I, P.W.N. , Warsaw, 1974, 73-108. 



44 



Figures Captions 

Fig.l. Geodesic on a surface of revolution. 

Fig.2. The phase function for different surfaces of revolution. Cross-sections of the 

surfaces of revolution are shown in the lower part of the figure. 

Fig. 3. Curve T for the surfaces of revolution shown on Fig.2. 

Fig.4. Sectorial domain with points of inflection on the boundary. 

Fig. 5. Local structures of V. 

Fig.6. Basis ei, ei- 
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